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(54) Colour image processing apparatus and method 



(57) In order to provide an image processing appa- 
ratus and an image processing method whereby a high 
quality output image can be consistently obtained, re- 
gardless of the order in which an operator sets the pa- 
rameters forthe performance of filtering, ( I ) a GUI mod- 
ule (9a) stores, in an input value storage area (9p) of a 



RAM, reference signs that are employed for first to 
fourth processes for the filtering of reduced image data, 
and ( II ) a filtering module (9f) refers to the reference 
signs in the input value storage area (9p) when perform- 
ing the first to the fourth processes for the filtering of 
input image data, and obtains output image data. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The present invention relates to an image 
processing apparatus and an image processing meth- 
od. More particularly, the present invention relates to a 
digital image filtering apparatus and a digital image fil- 
tering method. Further, the present invention relates to 
a recording medium, such as a computer readable me- 
dium, having recorded thereon a processing program 
for permitting a computer to perform image processing 
routines. 

[0002] The present application is based on Japanese 
Patent Application No. Hei. 11-280907, which is incor- 
porated herein by reference. 

2. Description of the Related Art 

[0003] Conventionally, using filters to change the im- 
age quality of digital image data that are output is a well 
known process. In this explanation, unless otherwise 
specified, filtering represents a concept that includes 
spatial filtering, tone correction and gray level correction 
processes. Enhancement filtering, for example, which 
is a kind of spatial filtering, is a process for emphasizing 
the contrast between adjacent pixels to enhance detail- 
ing, such as at edges, around corners and along lines. 
[0004] Generally, when an image processing applica- 
tion performs multiple kinds of filtering, these processes 
are performed in the order corresponding to that stipu- 
lated by an operator for the parameters established to 
perform the filtering, until finally, the results are output 
to a display. Thus, when for such an application an op- 
erator sets in a specific order parameters for spatial fil- 
tering and for gray level correction, for example, the 
processing is performed in that order. In addition, an op- 
erator may, while confirming the quality of an image out- 
put to a display, change the parameters for the perform- 
ance of filtering by determining which parameters to use 
to obtain a desired image quality for the output of an 
image to a printer. 

[0005] When the filtering of image data is performed, 
generally, as a result of the processing involved, color 
information and spatial information are reduced. For ex- 
ample, when the number of gray levels is reduced or 
increased to alter the brightness of an HSB (Hue, Sat- 
uration, and Brightness) model, two pixels that before 
the processing had different brightness levels may both 
have the same level after the processing has been com- 
pleted. Also, a reduction in the total amount of color in- 
formation, which is accomplished by employing a 
number of different processes for filtering, varies in con- 
sonance with the order in which the processes are per- 
formed. Therefore, the quality of the image data that is 
output fluctuates, depending in large part on the order 



in which filtering parameters are designated by a user. 
SUMMARY OF THE INVENTION 

5 [0006] To resolve this problem, it is an object of the 
present invention to provide an image processing appa- 
ratus and an image processing method whereby the da- 
ta that are output consistently ensure that a high quality 
image will be obtained, regardless of the order in which 

10 the parameters for the filtering are set. 

[0007] According to claim 1 , an image processing ap- 
paratus includes: 

a storage device which stores input image data in 

is a first area; 

refuging means which stores, in a second area of 
the storage device, sample image data produced 
from the input image data that has been stored in 
the first area; and 

20 pseudo display means which outputs, to a display, 
pseudo image data obtained by performing a 
number of different processes for filtering the sam- 
ple image data stored in the second area. There- 
fore, when a process for performing the filtering has 

25 been determined, the results obtained by the filter- 
ing can be displayed on a screen without the input 
image data having to be processed. The sample im- 
age data, for which the input image data were em- 
ployed as source data, can be, for example, data 

30 duplicating the input image data, data obtained by 
reducing the input data, or thumbnail image data 
produced using the input data. 

[0008] Parameter registration means stores, in a third 
35 area of the storage device, parameters that are to be 
referred to for each kind of process that is performed for 
filtering the sample image data in the second area. 
While referring to the parameters in the third area, filter- 
ing means performs, in a predetermined order, a 
*o number of different processes for filtering the input im- 
age data in the first area to obtain image data for output. 
Therefore, regardless of the order in which an operator 
designates the parameters for the filtering, different 
kinds of processes can be performed in the order that 
45 best provides an improved quality image. In other 
words, high quality image data can be consistently out- 
put. 

[0009] The parameters used for the process for filter- 
ing the input image data need not be the same as those 

so used for the process for filtering the sample image data. 
For example, for the processes used for filtering input 
image data and simulated image data, by referring to 
the parameters stored in the third area, new parameters 
may be obtained in accordance with the print size or the 

55 display size of an output image, and these new param- 
eters may be used to perform the process for filtering 
the input image data or the sample image data. Here, 
the storage device is a conceptual representation that 
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includes a main storage device and an auxiliary storage 
device. 

[0010] According to claim 2, the filtering means se- 
quentially performs, in accordance with an order estab- 
lished to minimize color information and spatial informa- 5 

„ tion reductions, a number of different processes for fil- 
tering the input image data. As a result, the output image 
quality is improved. 

• [001 1] According to claim 3, for the input image data 
stored in the first area, the filtering means performs, in 
the named order, a tone curve correction process for an 
RGB model, a saturation correction process for an HSB 
model, and a spatial filtering correction process. There- 
fore, color information and spatial information reduc- 
tions due to filtering can be minimized. 
[0012] According to claim 4, the pseudo display 
means performs the number of different processes, in 
the same order as having been employed for the proc- 
esses performed in the first area for the input image da- 
ta, to filter the sample image data in the second area. 
As a result, a displayed image, which was obtained by 
performing the processes for filtering the sample image 
data, can approximate the output results obtained with 
the image data. 

[0013] According to claim 5, the refuging means gen- 
erates the sample image data by reducing a size of the 
input image data stored in the first area, and stores the 
sample image data in the second area of the storage 
device. Since the size of the sample image data is small- 
er than is that of the input image data, less time is re- 
quired to display the results obtained by the filtering, 
which is performed in accordance with the parameters. 
[0014] According to claim 6 or 11 , an image process- 
ing method or a computer readable medium having re- 
corded thereon a processing program for permitting per- 
formance of a computer, is provided. The image 
processing method, or the processing program, in- 
cludes the steps of : 



which the parameters for filtering are designated by 
an operator, the order in which the various process- 
es are performed is the one that can best improve 
the output image quality. In other words, high quality 
image data can be consistently output. 

[0015] According to claim 7 or 12, the order in which 
a variety of processes, for filtering the input image data 
in the first area, are sequentially performed to minimize 
the reduction in color information and in spacial infor- 
mation, and thereby improves the quality of the image 
that is output. 

[0016] According to claim 8 or 13, corrective filtering 
for the input image data in the first area is performed in 
order in consonance with the sequential arrangement of 
tone curve correction for an RGB model, saturation cor- 
rection for an HSB model in the input image data, and 
spatial information correction. As a result, a reduction in 
color information and in spatial information due to filter- 
ing can be minimized. 

[0017] According to claim 9 or 14, the number of dif- 
ferent processes are performed for filtering the sample 
image data in the second area in the same order as that 
used for the processes performed for filtering the input 
image data in the first area. Thus, a displayed image 
obtained by performing the filtering for the sample image 
data can approximate the results provided for the output 
image data. 

[0018] According to claim 10 or 15, the sample image 
data is generated by reducing a size of the input image 
data in the first area and storing the resultant data in the 
second area of the storage device. Since the size of the 
sample image data is smaller than that of the input im- 
age data, the time required to display the results ob- 
tained by the filtering performed in accordance with the 
parameters can be reduced. 

BRIEF DESCRIPTION OF THE DRAWINGS 
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storing, in a second area on a storage device, sam- *o 
pie image data produced from input image data that 
has been stored in a first area of the storage device; 
and 

outputting, to a display, pseudo image data ob- 
tained by performing a variety of processes to filter 45 
the sample image data stored in the second area. 
Therefore, since a variety of processes are per- 
formed when the sample image data are filtered, the 
obtained results can be reflected in the processing 
performed for the input image data. Further, param- so 
eters that are referred to for each process, when the 
filtering of the sample image data in the second area 
is performed, are stored in a third area of the stor- 
age device. By referring to these parameters, the 
various filtering processes can be performed in a 55 
predetermined order for filtering the input image da- 
ta in the first area, and output image data can be 
obtained. Therefore, regardless of the order in 



[0019] 

Fig. 1 is a specific diagram illustrating the correla- 
tion among individual modules of an image 
processing apparatus according to one embodi- 
ment of the present invention; 
Fig. 2 is a block diagram illustrating an image 
processing system according to the embodiment of 
the present invention; 

Fig. 3 is a flowchart showing the filtering processing 
performed by the image processing apparatus ac- 
cording to the embodiment; 
Fig. 4 is a specific diagram showing a screen dis- 
played by the image processing system according 
to the embodiment; 

Fig. 5 is a specific diagram showing a screen dis- 
played by the image processing system according 
to the embodiment; 

Fig. 6 is a specific diagram showing a screen dis- 
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played by the image processing system according 
to the embodiment; 

Fig. 7 is a specific diagram showing a screen dis- 
played by the image processing system according 
to the embodiment; 

Fig. 8 is a specific diagram showing a screen dis- 
played by the image processing system according 
to the embodiment; 

Fig. 9 is a specific diagram showing a screen dis- 
played by the image processing system according 
to the embodiment; and 

Fig. 10 is a specific diagram showing a screen dis- 
played by the image processing system according 
to the embodiment. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

[0020] A preferred embodiment of the present inven- 
tion now will be described with reference to Figs. 1 to 1 0. 
[0021] Fig. 2 is a diagram showing an image process- 
ing system that employs, as the nucleus of the system, 
an image processing apparatus 1 according to this em- 
bodiment. The image processing system comprises the 
image processing apparatus 1 , a printer 8 and a display 
device 10. 

[0022] A CPU (Central Processing Unit) 2 and a RAM 
(Random Access Memory) 3 t which is a storage device, 
are interconnected by a memory bus via a PCI memory 
control chip set (not shown). The memory bus is con- 
nected to a high-speed bus, which in turn is connected 
to peripheral devices, such as a graphics controller 4 
and a hard disk 5, for which high speed processing is 
required. The high-speed bus itself is connected to a 
low-speed bus via a bridge circuit (not shown). And con- 
nected to the low-speed bus is an input unit 6, such as 
a mouse or a keyboard, and an interface 7. 
[0023] Under the control of an operating system 
(hereinafter referred to as an OS), the image processing 
apparatus 1 executes an image processing application 
9, which is loaded into the RAM 3, and outputs image 
data to the graphics controller 4 and to the printer 8. The 
image processing application 9 will now be described 
while referring to Figs. 1 and 2. 
[0024] The image processing application 9 comprises 
a graphical user interface module (hereinafter referred 
to as a GU I module) 9a, a parameter calculation module 
9e, a filtering module 9f, a printerdriver interface module 
(hereinafter referred to as a PDI module) 9g, a reduction 
module 9c, a simulated parameter calculation module 
9b and a simulated filtering module 9d. Further, the im- 
age processing application 9 acquires, in the RAM 3, an 
input value storage area 9p, used to store a value en- 
tered by an operator when the application 9 is executed; 
an input image data storage area 9q, used to store input 
image data that are retrieved from the hard disk 5; an 
output image data storage area 9s, used to store output 
image data; a reduced image data storage area 9r, used 
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to store reduced image data that serve as sample data; 
a preview image data storage area 9t, used to store pre- 
view image data that serve as pseudo image data; and 
a thumbnail data storage area 9u, used to store thumb- 
s nail data for the input image data. Values that are en- 
tered by an operator and are stored in the input value 
storage area include: a tone curve setting reference 
sign, a saturation setting reference sign, a sharpness 
effect setting reference sign, a special effect setting ref- 
erence sign and a texture setting reference sign, all of 
which are referred to by the parameter calculation mod- 
ule 9e and the simulated parameter calculation module 
9b, and a print setting reference sign, which is referred 
to by the parameter calculation module 9e and the PDI 
module 9g. 

[0025] The GUI module 9a, which is executed by the 
CPU 2 and serves as parameter registration means, is 
a processing program for outputting to the display de- 
vice 1 0 the operating screens shown in Figs. 4 to 1 0, for 
storing in the input value storage area 9p a value that is 
entered by the operator using the input unit 6, and for 
issuing to the graphic interface of the OS a drawing com- 
mand for the preview image data. 
[0026] The parameter calculation module 9e is a 
processing program for calculating parameters that are 
used, in the processing for the filtering of input image 
data, by referring to the tone curve setting reference 
sign, the saturation setting reference sign, the sharp- 
ness effect setting reference sign, the special effect set- 
ting reference sign, the texture setting reference sign 
and the print setting reference sign, which are stored in 
the input value storage area 9p by the GUI module 9a, 
and for transmitting these parameters to the filtering 
module 9f. 

[0027] The filtering module 9f, which is executed by 
the CPU 2 and serves as filtering means, is a processing 
program for sequentially performing, based on the pa- 
rameters received from the parameter calculation mod- 
ule 9e, the following filtering processes for the input im- 
age data. 

(1) First process for using filtering to change the 
tone curve of an RGB (Red, Green and Blue) model 
for image data. 

(2) Second process for using filtering to change the 
saturation of an HSB (Hue, Saturation and Bright- 
ness) model for image data. 

(3) Third process for performing spatial filtering to 
enhance or provide shading for the outline of an im- 
age. 

(4) Fourth process for performing calculations to 
generate a regularly textured image. 

[0028] The individual processes will now be ex- 
plained. 

[0029] For the first process, the parameter obtained 
by using the tone curve setting reference sign is em- 
ployed for the filtering performed to change the tone 
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curve of image data (RGB model) and to correct the in- 
tensity levels of the RGB colors. 
[0030] For the second process for performing filtering, 
the resultant image data (RGB model) provided by using 
the first process are converted into an HSB model, and 

. the parameter obtained by using the saturation setting 
reference sign is employed for the filtering performed to 
correct the saturation level of the image data of the HSB 

- model. 

[0031] For the third process for performing filtering, 
the resultant image data (HSB model) provided by using 
the second process are converted into an RGB model, 
and the parameter obtained by using the sharpness ef- 
fect setting reference sign is employed for the filtering 
performed to extract a correction target pixel in accord- 
ance with a threshold value designated by an operator. 
The radial correction range for a target pixel is deter- 
mined in accordance with the width of the outline des- 
ignated by the operator. Then, the contrast is enhanced 
in accordance with a distance for the range designated 
by the operator. 

[0032] For the fourth process for performing filtering, 
the intensity levels of the RGB colors in the image data 
(RGB model) provided by the third process are correct- 
ed at regular intervals in raster space, so that the pattern 
of the texture that is determined in accordance with the 
texture setting reference sign can be represented on the 
output image. 

[0033] This completes the explanation of the filtering 
processes. 

[0034] The PDI module 9g is a processing program 
for transmitting to a printer driver, via the graphics inter- 
face of the OS, the output image data obtained by the 
filtering module 9f , and a drawing command for the out- 
put image data. 

[0035] The reduction module 9c, which when execut- 
ed by the CPU 2 serves as refuging means, is a process- 
ing program for reducing the size of the input image data 
to obtain sample image data for 400 x 400 pixels, and 
for storing the sample image data in the reduced image 
data storage area. When, for example, the input image 
data is 1 600 x 1200 pixels, the reduction module 9c per- 
forms a 1/1 6 input image data pixel reduction to obtain 
a pixel count of 400 x 300, and stores the obtained im- 
age data in the reduced image data storage area 9r. 
[0036] The simulated parameter calculation module 
9b is a processing program for calculating a parameter 
that is used for the filtering of the reduced image data, 
while referring to the filtering setting reference sign that 
is stored in the input value storage area 9p, and for 
transmitting the parameter to the simulated filtering 
module 9d. The parameter is so obtained by the simu- 
lated parameter calculation module 9b that visually the 
resultant data acquired through the filtering of the input 
image data are substantially the same as the reduced 
data obtained through the filtering of the image data. 
[0037] The simulated filtering module 9d, which when 
executed by the CPU 2 serves as simulation display 



means, is a processing program for performing the first 
to the fourth processes for the filtering of the reduced 
image data based on the parameter received from the 
simulated parameter calculation module 9b. The code 
5 that is loaded into the CPU 2 when the simulated filtering 
module 9d performs the first to the fourth processes is 
substantially the same as the code that is loaded when 
the filtering module 9f performs the first to the fourth 
processes. 

10 [0038] An explanation will now be given for the oper- 
ation of the image processing apparatus 1 when per- 
forming the process for the filtering of the input image 
data in accordance with the procedures in Fig. 3, and 
for the output of the resultant image data to the printer 8. 

15 

STEP 10 

[0039] When the image processing application 9 is 
loaded into the RAM 3, the GUI module 9a stores a de- 

20 fault value in the input value storage area 9p, loads into 
the thumbnail storage area 9u the thumbnail data for im- 
age data that are stored in an auxiliary storage device, 
such as the hard disk 5, issues a drawing command to 
the graphics interface of the OS, transmits the thumbnail 

25 data to a video memory 41 , and displays a screen shown 
in Fig. 4 on the display device 10. 
[0040] The thumbnail data that are loaded into the 
thumbnail storage area 9 from the hard disk 5 are output 
to the screen in Fig. 4, and an image consisting of 20 

30 frames is displayed. The number of pixels in one of the 
images 1 04 displayed by using the thumbnail data is 1 60 
x 120, in accordance with, for example, JPEG (Joint 
Photographic Coding Experts Group). On this screen, it 
is possible to select the filtering setting or the print set- 

35 ting that is to be performed. When an image 104 is se- 
lected by using a pointer that intermeshes with the 
movement of the mouse, the filtering setting can be des- 
ignated for image data corresponding to the selected im- 
age 1 04. When an image 1 04 is selected, the GU I mod- 

40 ule 9a stores, in the input value storage area 9p, the 
address of the image data that corresponds to the se- 
lected image 1 04. 

STEP 20 

45 

[0041] When a filtering setting switch 101 is selected, 
the GUI module 9a loads, into the input image data stor- 
age area 9q, image data stored at an address in the in- 
put value storage area 9p. The reduction module 9c 

so generates reduced image data by reducing the input im- 
age data, and stores the thus obtained image data in 
the reduced image data storage area 9r The GUI mod- 
ule 9a then issues a drawing command to the graphics 
interface of the OS, and displays the screen shown in 

55 Fig. 5 on the display device 10. 

[0042] The screen in Fig. 5 is divided into a left display 
area, for a reduced image 1 1 8, and a right display area, 
for switches 107 to 111 and 114 to 117, to facilitate the 



5 



BNSDOC1D: <EP 



1089553A1 i > 



9 

selection of a process. 
[0043] Before a selected process for filtering is per- 
formed, the same contents are shown in the left display 
area of the screen by selecting either a filter tab 105 or 
an original tab 106. When either tab is selected, the re- 
duced image 118 is displayed in a reduced image dis- 
play area 119 of 400 x 400 pixels. Thus, when the GUI 
module 9a transmits the reduced image data from the 
reduced image data storage area 9r to the video mem- 
ory 41 , the reduced image 118 is displayed. 
[0044] In the right display area of the screen, the 
switches 1 07 to 1 1 1 and 1 1 4 to 1 1 7 are displayed to en- 
able the selection of one of the effects provided by the 
first to the fourth processes that is to be reflected by the 
output image. When one of the switches is selected, the 
contents in the right display area are changed as is 
shown in Fig. 6. Thus, when the brightness switch 107, 
the contrast switch 108 or the color balance switch 1 09 
is selected, a screen appears for the setting of a param- 
eter required for the first process for performing filtering. 
When the saturation switch 110 is selected, a screen 
appears for the setting of a parameter required for the 
second process performed for filtering. When the sharp- 
ness switch 111 is selected, a screen appears for the 
setting of a parameter required for the third process per- 
formed for filtering. And when the texture switch 114 is 
selected, a screen appears for the setting of a parameter 
required for the fourth process performed for filtering . 
It should be noted that the left display area on the screen 
is not changed, regardless of which switch is selected. 

STEP 30 

(1) Setting of the first filtering process 

[0045] To designate the first process for the filtering 
of an input image, on the screen displayed by selecting 
the brightness switch 107, the contrast switch 108 or the 
color balance switch 109 in Fig. 5, the operator employs 
the GUI module 9a to change the tone curve setting ref- 
erence sign stored on the input value storage area 9p. 
[0046] When the contrast switch 108 is selected, the 
screen in Fig. 6 appears. On this screen, the tone curve 
setting reference sign can be altered to change the 
brightness level of the entire image. A slide switch 128 
is used to change the tone curve setting reference sign 
that is referred to in the first filtering process, so that the 
tone is changed in accordance with the brightness of the 
pixels, e.g., a bright pixel becomes brighter or a dark 
pixel becomes darker. A slide switch 127 is used for 
changing the tone curve setting reference sign, which is 
referred to during the first process, so that the brightness 
value limit for a bright pixel is changed. A slide switch 
126 is used to change the tone curve setting reference 
sign, which is referred to during the first process, so that 
the darkness value limit for a dark pixel is changed. Pre- 
set switches 121, 122 and 123 are used to move the 
slide switches 126, 127 and 128 to predetermined po- 
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sitions and to set the tone curve setting reference signs 
that are determined in advance. 
[0047] When the operator manipulates the preset 
switch 121, 122 or 123, or the slide switch 126, 127 or 
5 128, one of the following simulated filtering process is 
performed for the reduced image data. 

(i) In accordance with the manipulation performed 
by the operator, the GUI module 9a changes a part 

10 of the tone curve setting signs stored in the input 
value storage area 9p. Further, before the operator 
manipulates the preset switch 121, 122 or 123, or 
the slide switch 126, 127 or 128, the GUI module 
9a moves the tone curve setting reference sign from 

15 the input value storage area 9p to another area, so 
that the tone curve setting reference sign is returned 
to the previous state. 

(ii) The simulated parameter calculation module 9b 
refers to the tone curve setting reference sign, the 

20 saturation setting reference sign, the sharpness 
setting reference sign and the texture setting refer- 
ence sign for generating parameters used for the 
first to the fourth processes, and transmits the ob- 
tained parameters to the simulated filtering module 

25 gd. By using these parameters, the simulated filter- 
ing module 9d sequentially performs the first, the 
second, the third and the fourth processes for the 
filtering of the reduced image data to generate the 
preview image data, and stores the previous image 

30 data in the preview image data storage area 9t. 

[0048] The processing for the display of an image in 
the left display area of the screen will now be explained. 
[0049] When the original tab 1 06 is selected, the GUI 

35 module 9a issues a drawing command to the graphics 
interface of the OS, transmits the reduced image data 
to the video memory 41 , and displays, in the reduced 
image display area 1 1 9, the reduced image 1 1 8 that has 
not yet been subjected to filtering. 

40 [0050] When the filter tab 105 is selected, the GUI 
module 9a issues a drawing command to the graphics 
interface of the OS, transmits the preview image data to 
the video memory 41 , and displays, in the reduced im- 
age display area 119, the reduced image 118 that has 

45 been subjected to filtering. 

[0051] When an OK switch 125 is selected, the GUI 
module 9a changes the right display area of the screen 
of the display device 10 to the screen shown in Fig. 5. 
[0052] When the cancel switch 124 is selected, the 

so GUI module 9a returns to the input value storage area 
9p the filtering setting reference sign that has been 
stored in the GUI module 9a, and displays the screen in 
Fig. 5 on the display device 10. 
[0053] When the original tab 1 06 on the screen in Fig. 

55 5 is selected, the GUI module 9a issues a drawing com- 
mand to the graphics interface of the OS, transmits the 
reduced image data to the video memory 41, and dis- 
plays the reduced image 118. 
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[0054] When the filter tab 105 is selected on the 
screen in Fig. 5, the GUI module 9a issues a drawing 
command to the graphics interface of the OS, transmits 
the preview image data to the video memory 41 , and 
displays the reduced image 118. 

(2) Setting the second process 

[0055] To designate the second process for the filter- 
ing of an input image, on a screen in Fig. 7 that is dis- 
played when the saturation switch 1 1 0 is selected on the 
screen in Fig. 5, the operator employs the GUI module 
9a to change the saturation setting reference sign stored 
in the input value storage area 9p. 
[0056] A slide switch 1 37 is used to change the satu- 
ration setting reference sign that is to be referred to in 
the second process, so that the saturation levels of all 
the pixels are changed. Preset switches 131 to 135 are 
used to move the slide switch 137 to a predetermined 
position to set the saturation setting reference sign that 
is determined in advance. 

[0057] When the operator manipulates one of the pre- 
set switches 131 to 135 or the slide switch 137, the fol- 
lowing simulated process is performed to filter the re- 
duced image data. 

(i) In accordance with a manipulation performed by 
an operator, the GUI module 9a changes a part of 
the saturation setting reference sign in the input val- 
ue storage area 9p. Further, before the operator 
manipulates one of the preset switches 131 to 135 
or the slide switch 137, the GUI module 9a moves 
the saturation setting reference sign from the input 
value storage area 9p to another area, so that the 
saturation setting reference sign can be returned to 
its previous state. 

(ii) The simulated parameter calculation module 9b 
refers to the tone curve setting reference sign, the 
saturation setting reference sign, the sharpness 
setting reference sign and the texture setting refer- 
ence sign to generate parameters used for the first 
to the fourth filtering processes, and transmits the 
obtained parameters to the simulated filtering mod- 
ule 9d. By using these parameters, the simulated 
filtering module 9d sequentially performs the first, 
the second, the third and the fourth filtering proc- 
esses for the reduced image data, and generates 
the preview image data and stores the previous im- 
age data in the preview image data storage area 9t. 

[0058] The procedure for displaying an image in the 
left display area of the screen is performed in the same 
manner as is the procedure for setting the first process 
for performing filtering. 



(3) Setting of the third process for performing 
filtering 

[0059] To designate, on a screen in Fig. 8 that is dis- 

5 played when the sharpness switch 111 is selected on 
the screen in Fig. 5, the third process for the filtering of 
an input image, an operator employs the GUI module 
9a to change the sharpness setting reference sign 
stored in the input value storage area 9p. 

10 [0060] A slide switch 1 75 is used to change the sharp- 
ness setting reference sign that is to be referred to in 
the third process, so.that the contrast enhancement lev- 
el is changed. A slide switch 1 77 is used to change the 
sharpness setting reference sign that is to be referred 

is to in the third process, so that, when a target pixel for 
changing the contrast with an adjacent pixel is extract- 
ed, the threshold value for the contrast between the tar- 
get pixel and its adjacent pixel is changed. Preset 
switches 171 , 172 and 173 are used to move the slide 

20 switch 175 to a predetermined position to set for the 
sharpness setting reference sign setting a level that has 
been determined in advance. 

[0061] When an operator manipulates the preset 
switch 171, 172 or 173 or the slide switch 175, the fol- 
25 lowing simulated process is performed to filter the re- 
duced image data. 

(i) In accordance with the manipulation performed 
by the operator, the GUI module 9a changes a part 

30 of the sharpness setting reference sign in the input 
value storage area 9p. Further, before the operator 
manipulates one of the preset switches 171 to 173 
or the slide switch 175, the GUI module 9a moves 
the sharpness setting reference sign from the input 

35 value storage area 9p to another area, so that the 
sharpness setting reference sign can be returned 
to its previous state. 

(ii) The simulated parameter calculation module 9b 
refers to the tone curve setting reference sign, the 

40 saturation setting reference sign, the sharpness 
setting reference sign and the texture setting refer- 

* ence sign to generate parameters for use for the 
first to the fourth processes for performing filtering, 
and transmits the obtained parameters to the sirn- 

45 ulated filtering module 9d. By using these parame- 
ters, the simulated filtering module 9d sequentially 
performs the first, the second, the third and the 
fourth processes to filter the reduced image data 
and to generate the preview image data, and stores 

50 the previous image data in the preview image data 
storage area 9t. 

[0062] The procedure performed for displaying an im- 
age in the left display area of the screen is performed in 
ss the same manner as is the procedure for setting the first 
process for performing filtering. 



7 



<BP 1 089553A1_I_> 



13 



EP 1 089 553 A1 



(4) Setting of the fourth process for performing 
filtering 

[0063] To designate the fourth process for filtering an 
input image, on a screen in Fig. 9 that is displayed when 
the texture switch 113 is selected on the screen in Fig. 
5, an operator employs the GUI module 9a to change 
the texture setting reference sign stored in the input val- 
ue storage area 9p. 

[0064] Texture switches 141, 142 and 143 are used 
to change the texture setting reference sign and to de- 
termine the size of a regular pattern, for which the bright- 
ness levels are uneven, that is generated for an output 
image. When an operator manipulates the texture 
switch 1 41 , 1 42 or 1 43, the following simulated process 
is performed to filter reduced image data. 

(i) In accordance with the manipulation performed 
by the operator, the GUI module 9a changes a part 
of the texture setting reference sign in the input val- 
ue storage area 9p. Further, before the operator 
manipulates one of the preset switches 141 to 143, 
the GUI module 9a moves the texture setting refer- 
ence sign from the input value storage area 9p to 
another area, so that the texture setting reference 
sign can be returned to its previous state. 

(ii) To generate parameters to be used for the first 
to the fourth processes performed for filtering, the 
simulated parameter calculation module 9b refers 
to the tone curve setting reference sign, the satura- 
tion setting reference sign, the sharpness setting 
reference sign and the texture setting reference 
sign, and thereafter transmits the obtained param- 
eters to the simulated filtering module 9d. By using 
these parameters, the simulated filtering module 9d 
sequentially performs the first, the second, the third 
and the fourth processes for filtering the reduced 
image data and generating the preview image data, 
and stores the previous image data in the preview 
image data storage area 9t. 

[0065] The procedure employed for displaying an im- 
age in the left display area of the screen is performed in 
the same manner as is the procedure used to set the 
first filtering process. 

[0066] When the above processing is completed and 
the OK switch 112 on the screen in Fig. 5 is selected, 
the GUI module 9a issues a drawing command to the 
graphics interface of the OS, transits the thumbnail data 
to the video memory 41 , and displays the screen shown 
in Fig. 4 on the display device 10. 
[0067] When the cancel switch 113 on the screen in 
Fig. 5 is selected, the GUI module 9a returns all the fil- 
tering setting reference signs in the input value storage 
area 9p to their default values. The GUI module 9a then 
issues a drawing command to the graphics interface of 
the OS, transmits the thumbnail data to the video mem- 
ory 41 , and displays the screen in Fig. 4 on the display 
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device 10. 
STEP 40 

5 [0068] When the print setting switch 102 on the 
screen in Fig. 4 is selected, the GUI module 9a issues 
a drawing command to the graphics interface of the OS 
and displays a screen shown in Fig. 10 on the display 
device 1 0. 

[0069] On this screen, the print paper size and the lay- 
out of an image designated by an operator can be set. 
[0070] When a postcard tab 1 61 , a photocard tab 1 60 
or an A4 tab 1 59 is selected, a paper size corresponding 
to the selected tab is set, and icons 151 , 152, 153, 157 
and 1 58 are displayed to represent the available layouts 
for the pertinent paper sizes, and a check mark 156 is 
displayed to indicate an icon that was selected by an 
operator. When in this case the tab is selected, the GUI 
module 9a changes the print setting reference sign that 
corresponds to the parameter used to determine the pa- 
per size; and when an icon is selected, the GUI module 
9a changes the print setting reference sign that corre- 
sponds to the parameter used to determine the layout. 



[0071] When an OK switch 154 is selected on the 
screen in Fig. 10, the image processing application 9 
performs the filtering and the printing of the input image 
data in the following procedures. 
[0072] To generate parameters used for the first to the 
fourth filtering processes, the parameter calculation 
module 9e refers to the tone curve setting reference 
sign, the saturation setting reference sign, the sharp- 
ness setting reference sign and the texture setting ref- 
erence sign, and thereafter transmits the obtained pa- 
rameters to the filtering module 9f. Using these param- 
eters, the filtering module 9f sequentially performs the 
first to the fourth processes for filtering the input image 
data and generating the output image data, and stores 
the output image data in the output image data storage 
area 9s. 

STEP 60 

[0073] The PDI module 9g issues to a printer driver, 
via the graphic interface, a drawing command for the 
output image data. At this time, the PDI module 9g refers 
to the print setting reference sign to reflect to the drawing 
command the print paper size and the layout, and the 
printer driver issues a print command to the printer 8, 
which in turn initiates the printing. 
[0074] The operation of the image processing appa- 
ratus 1 has been explained for the performance of the 
processing for filtering image data and for outputting the 
image data to the printer 8 in consonance with the pro- 
cedures in Fig. 3. 

[0075] According to the image processing apparatus 



15 



20 



25 STEP 50 



30 



35 



40 



45 



50 



8 



BNSDOCID: <EP 1089553A1_I_> 



15 



EP 1 089 553 A1 



16 



of this embodiment, to set up the process for performing 
filtering, the results obtained by the simulated process 
are displayed on the screen in real time in accordance 
with the manipulations of the switches performed by an 
operator. Therefore, the operator can specify the per- 
. formance of filtering while confirming the results of the 
simulated process. 

[0076] Further, regardless of the order in which the 
• operator sets the filtering processes at STEPs 20 and 
30, a variety of filtering processes are performed in a 
predetermined order by referring to the tone curve set- 
ting reference sign, the saturation reference setting 
sign, the sharpness setting reference sign, the texture 
reference setting sign and the print setting reference 
sign, all of which are stored in the input value storage 
area 9p. Thus, various kinds of filtering processes can 
be performed in the order that can best improve the 
quality of output images. In other words, high quality im- 
ages can consistently be output. 
[0077] In addition, since the tone curve correction 
(first process for performing filtering) for an RGB model, 
the saturation correction (second process) for an HSB 
model and the spacial filtering process (third process) 
are performed in the named order, the reduction of color 
information and the spacial information can be mini- 
mized. Furthermore, a special process (a fourth proc- 
ess) that does not depend on the original image can be 
performed after the processes (the first to the third proc- 
esses) that depend on the original image, while the op- 
erator can obtain a desired output image quality based 
on the image of a pickup object that he or she observes. 
[0078] Moreover, since the order for performing the 
filtering processes for the input image data matches the 
order for performing the filtering processes for the re- 
duced image data, the filtering effects appearing on an 
image in a display can approximate the filtering effects 
appearing on an image output to the printer 8. 
[0079] Also, since the image data obtained by reduc- 
ing the input data are employed for the simulated proc- 
ess, and since the size of the reduced image data is 
smaller than the size of the input image data, the results 
obtained by the simulated processing can be quickly dis- 
played on the screen for setting up the filtering. 
[0080] In this embodiment, the image data are finally 
transmitted to the printer 8. However, instead of trans- 
mitting the image data to the printer 8, the image data 
may be stored on an auxiliary storage device, such as 
the hard disk 5. The storage locations of the data en- 
tered upon the execution of each module, the data finally 
output and the data output during the process are not 
limited to the RAM 3. A part of these data may be stored 
in the register of the CPU 2, instead of the RAM 3. Fur- 
ther, the preview image data storage area 9t may not be 
acquired in the RAM 3, and preview image data may be 
output directly to the video memory 41 . 
[0081 ] A computer readable medium, such as a com- 
pact disk or a floppy disk, may be employed to distribute 
the image processing application 9. Further, such a 



processing program may be recorded at a terminal com- 
puter when a server machine transmits a carrier to a 
communication line by Internet. 

5 

Claims 

1 . An image processing apparatus, comprising: 

10 a storage device which stores input image data 

in a first area; 

refuging means which stores, in a second area 
of the storage device, sample image data pro- 
duced from the input image data that has been 

is stored in the first area; 

pseudo display means which outputs, to a dis- 
play, pseudo image data obtained by perform- 
ing a number of different processes for filtering 
the sample image data stored in the second ar- 

20 ea; 

parameter registration means which stores, in 
a third area of the storage device, parameters 
that are to be referred to for each kind of proc- 
ess that is performed for filtering the sample im- 

25 age data in the second area; and 

filtering means which, while referring to the pa- 
rameters in the third area, performs, in a pre- 
determined order, a number of different proc- 
esses for filtering the input image data in the 

30 first area to obtain image data for output. 

2. An image processing apparatus according to claim 
1, wherein the filtering means sequentially per- 
forms, in accordance with an order established to 

35 minimize color information and spatial information 
reductions, a number of different processes for fil- 
tering the input image data. 

3. An image processing apparatus according to claim 
40 1 or 2, wherein, for the input image data stored in 

the first area, the filtering means performs, in the 
named order, a tone curve correction process for an 
RGB model, a saturation correction process for an 
HSB model, and a spatial filtering correction proc- 
45 ess. 

4. An image processing apparatus according to claim 
1, 2 or 3, wherein the pseudo display means per- 
forms the number of different processes, in the 

so same order as having been employed for the proc- 
esses performed in the first area for the input image 
data, to filter the sample image data in the second 
area. 

55 5. An image processing apparatus according to one 
of claims 1 to 4, wherein the refuging means gen- 
erates the sample image data by reducing a size of 
the input image data stored in the first area, and 
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stores the sample image data in the second area of 
the storage device. 

6. An image processing method, comprising the steps 
of: 

storing, in a second area of a storage device, 
sample image data produced from input image 
data that has been stored in a first area of the 
storage device; 

outputting, to a display, pseudo image data ob- 
tained by performing a number of different proc- 
esses for filtering the sample image data stored 
in the second area; 

storing, in a third area of the storage device, 
parameters that are to be referred to for each 
kind of process that is performed for filtering the 
sample image data in the second area; and 
performing, while referring to the parameters in 
the third area, in a predetermined order, a 
number of different processes for filtering the 
input image data in the first area to obtain im- 
age data for output. 

7. An image processing method according to claim 6, 
wherein the order in which the processes, for filter- 
ing the input image data in the first area, are se- 
quentially performed to minimize the reduction in 
color information and in spacial information, and 
thereby improves the quality of the image that is out- 
put. 

8. An image processing method according to claim 6 
or 7, wherein corrective filtering for the input image 
data in the first area is performed in order in conso- 
nance with the sequential arrangement of tone 
curve correction for an RGB model, saturation cor- 
rection for an HSB model in the input image data, 
and spatial information correction. 

9. An image processing method according to claim 6, 
7 or 8, wherein the number of different processes 
are performed for filtering the sample image data in 
the second area in the same order as that used for 
the processes performed for filtering the input im- 
age data in the first area. 

10. An image processing method according to one of 
claims 6 to 9, wherein the sample image data is gen- 
erated by reducing a size of the input image data in 
the first area and storing the resultant data in the 
second area of the storage device. 

11 . A computer readable medium having recorded ther- 
eon a processing program for permitting perform- 
ance of a computer, the processing program com- 
prising: 



a storage processing routine for storing, in a 
second area of a storage device, sample image 
data produced from input image data that has 
been stored in a first area of the storage device; 
5 a pseudo display processing routine for output- 

ting, to a display, pseudo image data obtained 
by performing a number of different processes 
for filtering the sample image data stored in the 
second area; 

10 a parameter registration processing routine for 

storing, in a third area of the storage device, 
parameters that are to be referred to for each 
kind of process that is performed for filtering the 
sample image data in the second area; and 
is a filtering processing routine for, while referring 

to the parameters in the third area, performing, 
in a predetermined order, a number of different 
processes for filtering the input image data in 
the first area to obtain image data for output. 

20 

1 2. A computer readable medium according to claim 1 1 , 
wherein the order in which a variety of processes, 
for filtering the input image data in the first area, are 
sequentially performed to minimize the reduction in 

25 color information and in spacial information, and 
thereby improves the quality of the image that is out- 
put. 

13. A computer readable medium according to claim 11 
30 or 12, wherein corrective filtering for the input image 

data in the first area is performed in order in conso- 
nance with the sequential arrangement of tone 
curve correction for an RGB model, saturation cor- 
rection for an HSB model in the input image data, 
35 and spatial information correction. 

14. A computer readable medium according to claim 11 , 
1 2 or 1 3, wherein the number of different processes 
are performed for filtering the sample image data in 

40 the second area in the same order as that used for 
the processes performed for filtering the input im- 
age data in the first area. 

15. A computer readable medium according to one of 
45 claims 11 to 14, wherein the sample image data is 

generated by reducing a size of the input image da- 
ta in the first area and storing the resultant data in 
the second area of the storage device. 
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FIG. 3 
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